This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the 
original documents submitted by the applicant 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 

As rescanning documents will not correct images, 
please do not report the images to the 
Image Problems Mailboi. 



S3 

?t 1/5/1 



1 PN="3-110421 



1/5/1 

DIALOG (R) File 347:JAPIO 

(c) 2002 JPO & JAPIO. All rts . reserv. 
05439742 **Image available** 

ACTION DETECTOR, SIMULATOR AND ACTION DETECTION METHOD 



PUB. NO. : 
PUBLISHED: 
INVENTOR ( s ) : 

APPLICANT (s) : 

APPL. NO. : 
FILED: 
INTL CLASS: 

JAPIO CLASS: 



JAPIO KEYWORD 



09-054542 [ JP 9054542 A] 
February 25, 1997 (19970225) 
IGARI MASAKAZU 
MATSUDA YASUSHI 

NAMCO LTD [472204] (A Japanese Company or Corporation) , JP 
( Japan) 

07-230809 [JP 95230809] 
August 16, 1995 (19950816) 

[6] G09B-009/34; A63F-009/22; G06F-003/033; G06T-015/00; 
G06T-015/20; G01C-019/00 

30.2 (MISCELLANEOUS GOODS — Sports & Recreation); 45.3 
(INFORMATION PROCESSING — Input Output Units); 45.9 
(INFORMATION PROCESSING — Other); 46.1 (INSTRUMENTATION — 
Measurement) 

:R005 (PIEZOELECTRIC FERROELECTRIC SUBSTANCES) 



ABSTRACT 

PROBLEM TO BE SOLVED: To provide an action detector which is high in 
response speed, is small in size and is capable of making exact action 
detection, a simulator and a method for detecting the action. 



SOLUTION: A 
object for 
information 
information . 
information 
from either 



first detecting section 10 detects the angular velocity of an 
detection (for example, a player head), determines direction 
based thereon and outputs the information as first direction 
A second detecting section 30 determines the direction 
of the object for detection by generating a prescribed wave 
of the prescribed position (for example, wall, ceiling) in a 
three-dimensional space or the position (for example, on an HMD) following 
up the action of the object for detection and outputs this information as 
the second direction information. An action information calculating section 
60 makes correction arithmetic processing in accordance with the first 
direction information and the second direction information and determines 
the direction information of the object for detection. The action detection 
with high response and high accuracy is made possible by compensating the 
first direction information and second direction information with each 
other in such a manner. 
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(57) Abstract: 

PROBLEM TO BE SOLVED: To provide an 
action detector which is high in response 
speed, is small in size and is capable of 
making exact action detection, a simulator and 
a method for detecting the action. 

SOLUTION: A first detecting section 10 detects 
the angular velocity of an object for 
detection (for example, a player head), 
determines direction information based 
thereon and outputs the information as first 
direction information. A second detecting 
section 30 determines the direction 
information of the object for detection by 
generating a prescribed wave from either of 



the prescribed position (for example, wall, 
ceiling) in a three-dimensional space or the 
position (for example, on an HMD) following up 
the action of the object for detection and 
outputs this information as the second 
direction information. An action information 
calculating section 60 makes correction 
arithmetic processing in accordance with the 
first direction information and the second 
direction information and determines the 
direction information of the object for 
detection. The action detection with high 
response and high accuracy is made possible 
by compensating the first direction 
information and second direction information 
with each other in such a manner. 
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-ch 3©^T{C^LTS'J^tCfT^n^> 0 

[0 0 6 3] ch3<D^m\z-D^rh±$^^mm\zn 

t>tLZ> Uf-^H3. H8, H9, H14) . 

[0 0 6 4] ^2^[p|'|iIMfgl55 0 H 
^^i^Tt^t, i£f§ c h 1 ~ 3 co&Stff ffi 

&mc h 1 — 3CD&^tCOt^TCD#^> hiStC^? 
^T, gflc h l — 3 0^tIOViT<Z>fi:@1f«$2a3¥ 30 

UryyH15-H18) . JKB^cBfiyTKU: 
it (3) K^^TtT^tl*,, £&SS2;&fi-(fcfi1S« 

(7) ks^t, «ffi**A©*sn9«sjaiiLU 

«y^H 1 9) , mm*%*T-?z>o 
[0 0 6 5] &mttmzm$ttz>3km&& 3 & 
i^$nx^§§i^3^^^a^ auras 
mstA*±aatis?tc)S:s«'&) <Dmmz±mtmu-?& 

htiio (a) , (b) mm \ i trntmrnztz 40 

[0066] (HI 2 (A) , (B) RtfBl 3 tCti, ft 

^^^$nTi^itm^3-p^o, ^m^^icii^ 

(xl-Xl) '+ (y 1-Y1) ' + 

(x 1 -X 2) 1 + (y 1 - Y 2) 1 + 

(xl-X3) ' + (y 1 - Y3) 1 + 
(x2-Xl) I +(y2-Yl) I + 

(x 2 -X 2) ' + (y 2 - Y 2) ? + 

(x2-X3)' ! + (y2-Y3)' + 

(x 3 -X 1 ) 1 + (y 3 - Y 1 ) ? + 



&ffl¥9-5 4 5 4 2 
16 

K 7P-ft-h^tl^ 010 (A) , 
(B) tHl 2 (A) , (B) tcDffiiifcJ;, mi 2 

(A) , (B) Tte, 3®{H»gM8#3:3Tttfc< 2 

tHl 3t^)MH 01 3Tt£, §lchl-ch3 
Tli^<^lHchl, 2©tefi®#£jRgLT*5?> (X 
fy/I 16, 117), £*t_h5£ (7) Ttt&<.hSC 

(4) (cS^UT*lRj1f«*3tJi[UTli*^T*-5 
ry/I 1 9) . 

[0 0 6 7] B14 (A) , (B) 1 5 tCte, & 

ViSSMS*«3-p*S»'&<Z>^'D?/^0* ^-r 5 >^ 
K 7D-ft-h^Stl5. 010 (A) , 

(B) tH14 (A) , (B) <h<2*Siite, 014 

(A) , (b) ~c\z.* mmmm^3 8 a< 3 2 

tHl 5£cD4Biite, Hi 5Tte, f{|chl-ch3 
Wj;<lMchl, 2©tefi£MFUT*3?) (X^ 
^J16, J 1 7) , £*:_t:£ (7) -Cte&< JiiC 

(4) KS^T^|6Hfffi*SI}fLTti5^Ct?*S (X 
fy7J 1 9) „ 

[0 0 6 8] 5. 2imSR^SmS©fkjgBBfia 

[0 0 6 9] *»fiflajTttH2 (A) CiJ^T, ^(12* 
CSOi^ftSg) 4 2, 4 4, 4 6^ ^U-tO 

^bT^mgff4 4, 4 6£#gA/*:ttu ^4 4, 4 6 

©4>^tsms4 2 *«g^«i3£^jcsine><o2«itcii 

JgKlvWni2, 14, 1 6SEf CCD J: 

[0 0 7 0] WAtfHl 6JC5^-r«t5(C. 

nfci^ms§ (xfis®«) ©ftMtfg (teiajffigo £p 

1 (XI. Yl, ZD , P2 (X2, Y2, Z2) , 

P3 (X3, Y3, Z3) iu ^tti^icjgiae-rss 

{§22 (Xtt2lfiS) <0&e«ffi£Ql (xl, yl, z 
1), Q2 (x2, y 2, z2), Q3 (x3, y 3, 
z 3) JB!3£SnfclEltt* 1 1, 12, 13, m 

1, m2, m3, n 1 , n2, n3 f *<tT^ 

(9) , do), (id anaofc). 

(zl-Zl)'=ll ! 

(zl-Z2)'=12 ! 

(zl-Z3)'=l3' (9) 

(z 2 - Z 1 ) l =m 1* 

(z 2 - Z 2) 1 =m2 I 

(z 2 - Z 3) 1 =m3' - (10.) 

(z 3 -Z 1 ) ' = n l 1 



t 



17 



1 + 



10 



(x3-X2) ' + (y 3-Y2) 
(x 3-X3) * + (y 3-Y3) 
un^^iOQl (xl, yl, zl) , Q2 (x 
2, y2, z2), Q3 (x3, y3, z3) (D&Stf 

x 4= (xl+x2) /2 
y 4= (y 1 + y 2) /2 
z4= (zl + z2)/2 

MM£efit«*0 1 (Ox 1, Oyl, Oz 1) , 02 
(Ox2, Oy2, Oz2) , 03 (Ox3, Oy3, 
Oz3) , 04 (Ox4, Oy4, Oz4) tl, 
(x 3. y 3, z 3) 
= (Ox 3, Oy 3. O z 3) x R, 
(x 4, y 4, z 4) 
= (Ox 4, Oy 4, O z 4) X R, 

(x 1. y 1. z 1) 

= (Oxl.Oyl.Ozl) XR, 
(x 2, y 2, z 2) 

= (Ox 2. Oy 2. Oz 2) XR, 

(0.) , R, (0,) , R, -(0.) WU _hj£ 
(5) , (6) , (8) t'^bfc[HJi|fc^JT&£o 
[0 0 7 1] Jij^C&UTte, Q3tQ4 (03tO 
4) £Jg„Ktt|£Ztti, QltQ2 (01t02) 

TV>*. Z\tl\Z&Q* _t3£ (13) - (16) tC^T£ 

[0072] &\z#nffim<vmn^mv>mitLft$:m.wT 

(x 1, y 1. z 1) 
= (Ox 1. Oy 1. Oz 1) XR, 

(x 2, y 2. z 2) 
= (O x 2, O y 2, O z 2) XR, 

(x 3. y 3. z 3) 
= (Ox3.Oy3.Oz3) XR, 

±5t (1 3) - (1 6) t±SC (1 7) - (1 

9) *it«SE"rn^e»3&^<t'5tc. _bsc (n) - (i 

9) cos0, sin0<Z>3^0>Jl#fflT<*£:fi£>. ill 

[0 0 7 5] ffiiT«#*3K*S^ffi*C«tnK, &M<D3 

6©Q1, Q 2 . Q 3 t>m&<DtE.Jj * m 50 



( 10 ) 4£P§*P9 - 5 4 5 4 2 
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(z 3-Z 2) ! = n2' 
(z 3-Z3) '^nS 1 (1 1) 
Q4 (x4, y4. z 4) ©ffifilffffittT^J; !>3fc«e>* 



(1 2) 

^tf>&fififfg£Q 1 (xl, yl, z 1 ) , Q 2 (x 
2, y2, z2) , Q3 (x3, y3, z3) , Q4 
(x4, y 4, z4) ffZ> a 



(0.) XR, (0,) 



(0 ,) 

t5, 



XR, (0 T ) 



(0,) XR, (0.) 



(1 3) 



(1 4) 



(1 5) 



30 



(0 F ) XR, ( 0 , ) (1 6) 

[0 0 7 3] C©#&TC0ffl:«if«CDSt^«-hS: (9) 
- (1 1) tHflUc&S. {Bb_tiC (l 2) ©MMfiS 

[0 0 7 4] ^iRUffStt^i-Sfc***. KP*> 

0fcflfl©£*PMti!«£ 0 1 (Oxl, Oyl, Oz 
1) , 02 (Ox2, Oy2, Oz2) .'03 (Ox 
3, Oy3, Oz3) tU ®feSI©iac«««SQ 1 

(xl, yl, zl) v Q2 (x2, y2, z 2) , Q 
3 (x3, y3, z3) ttS, 



(0,) XR, (0,) XR, (0.) (1 7) 
(0.) XR, (0 y ) XR, (0,) (18) 
(dj XR, (6\) XR, (0, ) (1 9) 

u cintz:j:t)iHieftfiE^8&-5i3jtetti&*&^i;8e>ft 

#>T:fc< (Q3£Q4£jfcU^ QliQ2^iS 

txcn^co^tia^-r-s^tc^^^) o c^^^icr-S) 
-it, Kd7)-{i9) iZKT&oizmnmm 

[0 0 7 6] wzm2 (b) <Dm^\z-D^xwtm-r -5> 0 

*SEJfi0«TJiBI2 (B) (C*5^T, (Xtiitfl 
88) 4 2, 4 4£. :7V— \*<&SKg|S(0Hii#. 
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(x 1 -X 1) 1 + (y 1 - Y 1) : + 
(x 1 -X2) '+ (y 1 -Y2) 1 + 
(x 1 -X3) 1 + (y 1 - Y 3) 1 + 
(x2-Xl) ' + (y 2-Y1) * + 
(x2-X2) ' + (y 2-Y2) ' + 
(x 2 -X3) 1 + (y 2 - Y3) 1 + 
cn^^OQl (x 1, yl, z 1) , Q2 (x 
2, y2, z2) ©figfiW^ili^^.. 10 
(x 1. y 1. z 1) 

= (Ox 1. Oy 1. O z 1 ) XR, 
(x 2. y 2, z 2) 

= (Ox 2. Oy 2, O z 2) XR, 

[0 0 7 8] ^ (9) - (16) £5t (2 0) ~ <2 

3) sjtfe-rn«^e>*^,k'5tc:, ^2 (b) ©j^k 
Ea-rnti, mmt&m&^zffimit-ezz* y-&mz 

fflmtf«fc^«3-#£i>. tot, ^o^k^im 

[0079] e. smai, smois 

i p i - p i = i i 

I P 2 -P I = 1 2 

±5* (2 4) j&> S 9i 5 (C, Sfgg 

<Z>&BPte|2jl 8tC^T#liil 3 0 ± (P 1, P2j5^ 

agmi i, i 2<Dmm±) \z&z>ztiiztez>w. im± 30 
©<»fo{agtc&5^tti*3eT€rfeVi. tot, cn^# 

[0 0 8 1] WAtf^U-^WfflfilSCDftf^ttWSfT^a 

ntf, mi 9t^-r<t-5^ &mmim<Dttvti&i 3 2 

^T'€-So IP-S^O^ICH gmggOteSte, Mill 40 
3 0 tm 1 3 4 £<D^&<Di±LW\Zftl£ZriZ>o Z\<D3t& 

[0 0 8 2] COcfc^tC^l 3 4±-c<offia*<4*s$n 

scitT, yu-^<o5Ha5©2*iinf©^isiiff« (tn^ 
[0083] -jj, m2 oiz^r^oiz. gm§§#¥® 

1 3 6±T?<Dfr$h<£\,*o#m&ft&y&£. MZ.t£m 50 



( 11 ) #P!¥9 - 5 4 5 4 2 

20 

(z 1 -Z 1) 1 l 1 
(zl-Z2) I =12 1 
(zl-Z3) , = 13 I (2 0) 
(z 2-Z 1) ! =ml ! 
(z 2-Z2) 1 =m2 1 
(z 2-Z 3) ! =m3' (2 1) 
[0 0 7 7] — ^r|6Hit«fc^V>Ttt* 



(<9.) XR, (0,) 



(2 2) 



(0.) XR, (<9 T ) (2 3) 

[0 0 8 0] fiSJ^.«ffi«**WS$nTVi*3HIg**2 

h)i) *pi. P2, sm#go^e 

aims • sm»K©»Ei«s i i, i2tnt, 

(2 4) 

200137 (C^-Tct -5 fc. ¥® 13 6 ±T'©fiIfi 

fctesre**. c<7)^^, smooth, «tiii3o 

*©i£Bfcffll£#JfflT£S. 
[0 0 8 4] 6t_h©»f^ttffitt, {£B#^£tlT^£ 

[0 0 8 5] ffia**^5£anTVi*2img3&«2 

^-3£T*n«, -^cosms©ffia3ft*^stin«te 
^sms^teafcttsr?**. -haabfc, ant3ga*2 

(Ail 1 3 0 , 1 3 8 ^134 £<D&&<DtiLMlZ&fetE 

[o o 8 6] -^©amagoftBS^-rsctt?, 2 

fc#>. *£J@. 3«|-CC0^r6ltiia€3R«>5CltA*T#S. 

[0 0 8 7] @ 2 2 tc^Tcfc? ic, -#0 



( 12 
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t. 0y*_fc£EI2 2<D 1 3 9(c^TJ:^t^ ¥Ml 36i 

[0 0 8 8] £t±©»flsjfcfflfcJU #«#«8M£;*nT^5 

TfcWfcifcS. 10 
[0 0 8 9] (H»02) ^Jfi«|2tt, ^lTKW 

#JT&0, 02 3 (A) tC, -e©^Py^0CD— 

[0 0 9 0] 023 (A) (CiS^T* JSf^SB 3 0 0 

7u-t mm) tmftTzm^mftun-. a>k 
<zrc&o, t£fm3 o o xoAtiznfrmftmmMm 

SB2 0 OfcA^Sn*. 8BtSffi3 0 2ti, &M2 0 0 

^nfffi^^aHts-rst^ic, jaasis 2 o o ©f^sBix u 

7£&5t>©T?*l3, ROM, RAM, IBIt^ (CD 

[0091] 2 o o ts, mm^&omw&ft o t 
mz, mttffl3 o ofr£><Dmftmm&mmi$3 02c 

— Is a >9E.m& fro. ^frfl=J-J;5SS#y— ASrfifiltCt 

x^fT# (jRfx«, u-->>^;&-« zm-^oumw 30 

fir** >^©»f£icJt?DT^#©&J®Wfc: 3 3fc7c£HBl*9 

4I&SSB2 0 0W;, Slift^SS 2 0 2 *^T?*J 0 , z\<d 
M£rj5}cgE2 0 2ti, «ffl>tt*T&'60iJAtf7 r ^— \»© 

«6§c —tj. r PGy— Atr*5^^x(i, yu—^<Dm^ 

$SlC^>Tt>®!ifm£tiSB3 1 0l;:J:0&tBLTt>«fc^. 
[0 0 9 2] &:fc&>ftM&tBgfS3 1 OO^Ht^tSfc 



) #Bi¥9 -5 4 5 4 2 
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S. 

[0093] *fzmi<Dmii}fammmm$2 4, m2 

OfTt)nSiH®ffiStt, 0 2 3 0&M2 0 ORtffBfg 
g&3 0 2tCff^i±-SC:<!:t>T^^o IP^ d©»-&KJ4» 

f^ttiHas3 1 oo— «K3fi«ffiaa5 2 o o^mns^t 

[0 0 9 4] 023 (B) ta»«^t*5HMD 

^"T^ f^fX7K 3 2 0a»3 0 4 

*Plf££*l£ 0 3 2 OtCiOyu— Vfct 

&#®«£j!,£>;r<h#T£S. -?U—^m-£>~V-3 2 2 
teR)fmmS&3 1 0<D— t>£>T& D, ^JA^0 
2 (A) , (B) {C^f J:-5&**K©S®a5 7 2, 7 4 

xtr-^3 2 4ti, y-A^&yu-irKfi 

ASt>©T&S. K3 2 6fct, M2 0 0^ 

5©ffiffi«i«$f^X^W 3 2 0 

^t4^l/-^#J^>^3 2 2&e><D&mm&&9m&2 

[o o 9 5] f3.&*5&m\x±umMw i * 2\zm^n 
[0096] mx\tmi ^m^(Dmm^±%^mm\zm 

[0 0 9 7] *fc^2«ma5©«JGR'b±E^JigW(cIfi^ 

T, 0 4COX^'yyG3, G4, G 6 tC^TfflS^jS^ 
[0 0 9 8] *tSS2^aiffl5»Cct*»f^1S«<JD«im*. 

2 4 t^^-TcfcplC. XYZ(753^fn|tC3-r";l/^^n^i 
y-X=W;H 2 0 ffi«©XYZfi£^^fflartg^: 
-fe>tf-=KJH 2 2 t^ST^, ^-UT0iJA^y-X 
3<;n 2 0Sr3^7c^p B lrt<z>Rlr#ofi[®^is:tt t y— 
AU-f ;H 2 OODS^^n-fjUtcm^t^^tTCtT^ 
<OXYZ^rSjfi£»€:ie^:5e^$-&^. SfcflSJAtf^m^ 
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[0099] uvmi^ihmt(Dm^^^xrzm 

#<&flsU 04©*5^y:/G3, G4. G 6 iC^Tita 

m\z& 0 mmwuts nm^m u*>t ^ £ v> 5 30 

[0 10 0] SfcilHISJfifclTtt, fg2#ffiffl$K:*5^T 

[0101] ^2^mgp^, ffiia««tftm^rfi6?a: ■ 



*£*Wr*^ fcfclCJt^* 3&ffiTffinT45 
fc^. t£oT&m#*&<&(4fgtC^vr r J T^-f Ate 

^i^t±i^<h, iaew«©«aiA^^j:®2ttttigis 

Ct^tf^. 50 
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[0102] s&simsg, wumm&+<tn*$ 
©Est> 02 (a) , (b) n^-rfe^icts^n^feco 

ife* 3 ^tc^PbI^ ©3r ^©te@teia:tt3 «fc P tc LT 
[0 10 3] H^fflS.CXm^ffly-A^ 

y-A^a> jimisi^^ffl^Tffiyi/-^i:y-A^ 
mm. 3^c7ccAD^tc*3tt«3^7c#>f >^>y5 f 

[0 10 4] 

[02] 02 (a) , (b) a, jbes®»>*w 
[^3] 03 (a) , (b) \zmmmi<DW]ft&mw-r 

[04] 1 0»fPSSiWtSfc»07D-f t- 

[0 5] S*^j-«»KOHTItt^*rS&*CDHT& 
[0 6] 0 6 (A) - (C) fct, BEilKiyt-foOg 
[0 7] 0 7 (A) , (B) H. JEtSJSK^-fr-f PO«r 
[0 8] 0 8 (A) , (B) », iBS&S¥£fi]J8UT» 

[09] 09 (a) , (b) m^&m&mmis-cwi 

[010] 010 (A) , (B) tt, ^2^tii^©S*if^ 

[01 l] SS2tttiiaiS©fflif^&KWr*fc«6a)7D— 5=- 
[012] 012 (A) , (B) tt, ^2^mg6cDibf^ 

[0 13] SS2«lffiSIS0D!Kif^SKWr*fc«e)©7n— ^« 
[014] 014 (A) , (B) tt, ^2^tH^©Ut)f^ 

[0 1 5] $ 2 ttlflffll©ft^*KWt5fe8i>«)7 
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( 14 ) #i¥9 
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■16 jEHigib'/^-r n 
s& i 



[019] 2ira#a<2ffl. sms** HB©«-&©*i^nf 
[02 o] mmm^m, &mm*im<Dm&<D&wm io 
[02 1] &mm&2m* &m®&2m<D&&<D#$im 
[022] iM^2fi, &mm*2m<Dm&<D®:mm 

[02 3] 02 3 (A) li, ^ISS0iJ2CD-"0iJ^^-r^P 
'^STSO, 02 3 (B) \t. HMD0^J^^t0 

[02 4] «BE«*jpJfflLTft^1»«S^«>*¥ffi€lft^ 

-r&tztbomT'fo&o 20 

io jg i 



1 2 

1 8 

2 0 
2 2 

2 4 

3 0 

3 2-3 6 

3 8 j££$fflfi|5 

4 2-4 6 

4 8 %mmwm 
49 ti*y>? 

5 0 fg2;£ft*te 

6 0 

7 0 
7 2, 
2 0 0 

2 0 2 

3 0 0 
3 0 2 
3 0 4 
3 1 0 
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